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Problems with artificial neural networks originate from their deterministic nature and inevitable 
prior learnings, resulting in inadequate adaptability against unpredictable, abrupt environmental 
change. Here we show that a stochastically excitable threshold unit can be utilized by these systems 
to partially overcome the environmental change. Using an excitable threshold system, attractors 
were created that represent quasi-equilibrium states into which a system settles until disrupted 
by environmental change. Furthermore, noise-driven attractor stabilization and switching were 
embodied by inhibitory connections. Noise works as a power source to stabilize and switch attractors, 
and endows the system with hysteresis behavior that resembles that of stereopsis and binocular 
rivalry in the human visual cortex. A canonical model of the ring network with inhibitory connections 
composed of class 1 neurons also shows properties that are similar to the simple threshold system. 

PACS numbers: 05.40.Ca, 87.85.ff, 87.85. Or 



I. INTRODUCTION 



Sensory nerves of several biological systems includ- 
ing crickets crayfishes [2| and paddlefishes[3] exploit 
the phenomenon of stochastic resonance (SR) for weak 
signal detection within a noisy environment [J] . Previ- 
ous studies concerning cerebral physiology have provided 
evidence of SR following analysis of hippocampal slices 
from rat[j| and human [a 01 brains. For an adaptive sys- 
tem to successfully operate in an environment, it would 
be preferable to utilize a certain number of attractors, 
which represent quasi-equilibrium states into which the 
system settles until disrupted by environmental change, 
and an autonomous selection mechanism for one appro- 
priate attractor in the environment. However, the con- 
ventional view of SR phenomena lacks the concept that 
a process switches stochastically to the most preferable 
attractor. Recently, the concept of neuronal computa- 
tions with stochastic network states in the brain has also 
been accepted^. However, the functional role of noise 
in neuronal activity remains unknown. In this article, 
we assembled attractors composed of reverberating elec- 
tronic circuits in order to investigate the functional role of 
noise. The results obtained using an SR system based on 
an excitable threshold system Q revealed a higher-order 
function of the SR system and noise-driven attractor 
switching with a hysteresis phenomenon, which is beyond 
the well-known functions of noise-driven enhancement on 
both sensitivity to weak signal detection and signal prop- 
agation. In order to examine whether the higher-order 
function can be extended to more general neuronal mod- 
els than the simple excitable threshold system, we also 



performed a numerical simulation for a canonical model 
of a class 1 neural network [13, El Q3, M, G3 EE d • 
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II. METHODS 



A simple excitable threshold unit by an analog 
electronic circuit 



Fig. [T] shows an example of an analog operational am- 
plifier circuit of the simple excitable threshold unit. The 
circuit is composed of seven functional parts: multiple 
signal inputs, adder, inverter, comparator, inverter, neg- 
ative clipper, and an output port. The negative feedback 
circuits of operational amplifiers with a gain of unity were 
used for the adder and inverters. We used quad opera- 
tional amplifiers, TL084 (Texas Instruments, Inc.). The 
positive and negative electric power source used for the 
amplifiers was ± 12 V. The diode for the negative clip- 
per was 1S1558 (Toshiba, Corp., Japan). All the resistors 
used here are standard metal-film resistors. 



B. Implementation of an inhibitory connection by 
an analog electronic circuit 

Localization of neuronal excitations is a basic feature of 
brain function. In order to select an appropriate attractor 
in a certain environment, inhibitory connections are cru- 
cial to the localization of neuronal excitations. It would 
also be important for the connection to realize attractor 
switching against environmental change. An inhibitory 
connection was realized using the variable threshold of 
the excitable unit. The shutdown of noise generators 
that is triggered by the output of the other units can 
also be used as an inhibitory connection. Alternatively, 
the signal input of the inverted output of the other unit 
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will be available for this purpose. 



C. Electronic circuit experiments 

All data of output voltage for the attractor switch- 
ing electronic circuit (Figs. Q] and [3} were collected by 
a multifunction data logger (USB-6008; 12-bit longitu- 
dinal digital resolution; maximum sampling rate of 10 
kS/sec, National Instruments, Corp.), which was con- 
trolled through a general purpose interface bus (GPIB) 
via a high-speed universal serial bus (USB 2.0). The 
GPIB and data logger were handled using a graphical 
user interface built using Lab VIEW 8.2 (National Instru- 
ments, Corp.). Input signals and threshold voltages were 
synthesized by standard function generators (WF1974, 
NF, Corp., Japan). Gaussian white noise was synthe- 
sized using a function generator (33120A, Agilent Tech- 
nologies, Inc.) and fed into the input port of the sim- 
ple excitable units through an eighth-order Butterworth 
low-pass filter with a cutoff frequency of 50kHz (two VT- 
4BLA in box #3334, NF, Corp., Japan). The sampling 
rate of data collection was 1 k/sec. The average firing 
rate was determined by averaging digitized output sig- 
nals during 0.1 s (100 points). The response to the sinu- 
soidal input signal (0.1 Vx sin(wt); uj/2tt — 0.3 Hz) was 
recorded for 18 cycles (only data for the first three cycles 
is shown in Fig. [5Jd). The parameters used in Fig. \3jp 
were shown in Table UJ 



D. Numerical simulation for the network of simple 
excitable units 



The numerical simulation for simple excitable thresh- 
old systems was performed using McCulloch-Pitts 
neurons @. Let us consider a ring circuit (Fig. [2];) of 
M modules(Fig. [^b), where each module is composed 
of N parallel neurons(Fig. The output of the Tro- 

th module with N parallel neurons in ring X, V x (t), at 
time t is calculated using the following equation: 
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where H[u] is a Heaviside step function: 



H[u] 



1 if u > 
otherwise. 
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V X 



(t), x s mn (t), £m„(£) and r are the threshold value, 
sensory signal input, noise for the n-th excitable unit 
in the m-th module, and delay time, respectively. For 
simplicity, all the threshold units in a ring X have the 



same threshold value(Vy (i)). Note that the delay time 
is important to realize the recurrent network, is the 
coupling constant between the m-th and (m + l)-th mod- 
ules and is defined as the ratio of the input amplitude 
of (m + l)-module to the output amplitude of the m-th 
module. Noise is represented by the mutually indepen- 
dent and uncorrelated functions 



(e. 



III-)! 

(£»(*)} = 



D6 mp 8 nq S(t 
0. 







(4) 
(5) 



where (•} denotes time autocorrelation. The distribution 
function, p(x), with £j£ n (i) = x is defined as follows: 



p(x) = 



const, 
l 



: uniform noise 



exp(— jj ) : Gaussian noise 



(6) 



The numerical simulations for simple excitable thresh- 
old systems were performed on a personal computer with 
a Core 2 processor (1.86 GHz) and 1 GB of random ac- 
cess memory. A simulation program was written using 
GNU Octave (version. 2. 1.73) under the Vine Linux OS 
(version 3.3.6). All the parameters used in the simulation 
were dimensionless and summarized in Table. |H 



E. Numerical simulation for the ring network with 
asymmetric inhibitory connections using a canonical 
model for class 1 neurons 

A canonical model of class 1 neurons was employed 
to further investigate the properties of a two-ring sys- 
tem of stochastically excitable threshold units with in- 
hibitory connections (vide infra). Based on the the- 
ory by Ermentrout fiol [Ti| . Izhikevich[l2l Il3j , and 
Kanamaru[15l fla| . we interpreted the Langevin equation 
in the Stratonovich's sense: 
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where X = A or B and 9* n (t), rx and £„„(£) are in- 
ternal states of the n-th neuron in the m-th module, the 
bifurcation parameter for ring X, and noise applied for 
the ro-th neuron in the m-th module, respectively. £„„(£) 
is uniform white noise with a correlation of 



(Cmn(*)£ro'n'(*')) = DSxvSmm' 5nn> 5{t - t'), 



(8) 



where m,m' = 1, • • • ,M and ro,ro' = 1, • • • ,N. 5xy, 
Smm't and $nn' are Kronecker delta and 5(t—t') is Dirac's 
delta function. D is the noise amplitude. if™ S:X (t), 
K™ h > x (t) and K^ lm ' X {t) are signal inputs from the mod- 
ule of the upper stream in the ring, inhibitory signals 
from ring B to ring A, and the external sinusoidal input, 
respectively. 
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where e* x is the excitatory coupling constant between 
modules in ring X. The asymmetric inhibitory connec- 
tion is expressed as follows: 

\K^ B (t) = 0, ,J01 

where output current of the m-th module, I*(t), is ex- 
pressed as an averaging over individual output currents, 
/^(t), of the n-th neuron in the m-th module of ring 
X because of the parallel structure of modules (see Fig. 
I2b), 

1 N 

n=l 

l£(t) = - — (lL(t)-S(6^ n -n)), (12) 

and einh is the inhibitory coupling constant between 
rings. A sinusoidal sensory input is applied to the first 
module (m = 1) in each ring. 

K^ x {t) = A sig sinM) (if m = 1), (13) 

where A a i g and u> are the amplitude and angular fre- 
quency of the sinusoidal input signal, respectively. From 
EqJ7J QT] and [T21 the dynamics of 6g in was numerically 
calculated using an ordinary differential equation solver, 
" LSODE" [17| . All the parameters in the simulation were 
given in Table. [TTJ 

III. RESULTS AND DISCUSSION 

We focus on a simplified version of a recurrent neu- 
ral network: a ring circuit. In this architecture, positive 
feedback is localized to a single ring, which is the min- 
imum component of a complex web of the neural net- 
work. We first assembled a memory ring circuit driven 
by noise. The ring circuit shows a fundamental property 
of positive feedback that is found in the hierarchy of com- 
plex information processing in the human hrain[18l. Il9j]. 
We explored the properties of a single-ring circuit (Fig. 
[5b) of M modules (Fig. [5b), where each module was 
composed of N parallel threshold excitable units (Fig. 
[5b). This module is the so-called Collins model[2Gj with 
time delay, and it enhances the system's sensitivity to 
weak inputs without adjusting the non-zero level of noise 
amplitude, leading to enhancement of weak signal detec- 
tion and therefore signal propagation in sensory neurons. 
The numerical simulation for simple excitable threshold 
systems was performed using McCulloch-Pitts neurons [9| 
with uniform white noise, and dimensionless parameters 
were used to maintain the generality of the problem. The 
threshold and output amplitudes are defined as V™ and 
V m , respectively, and the details of the simulation are 
shown in Sec. II. D and the caption of Fig. [5J We looked 
at the stochastic response of the ring as a function of the 



number of parallels (N) in each module(Fig. [2b!) . In Fig. 
[5b!, the pulsed sinusoidal signal is stored in the ring as 
a form of summed neuronal spikes if independent noise 
with appropriate amplitude is applied to each unit. An 
extended lifetime of the stored signal was observed with 
increasing N (Fig. [5b!). 

In addition to the structural factor of ring circuits, we 
found that the noise amplitude and inter-module cou- 
pling constant were important in determining the decay 
rate of transient memory storage. Phase diagrams of the 
decay rate of memory (Fig. [2b) and signal-to-noise ratio 
(SNR) of the peak at a frequency of sinusoidal input in 
the Fourier power spectrum (Fig. [5J) were obtained by 
numerical simulation (see Sec. II. D) as functions of the 
inter-module coupling constant (e) and noise amplitude 
(D) for the single ring of (M,N) = (4,100). The rate 
was determined from the full-width at half-maximum 
(Aw) of the peak at the dimensionless input frequency 
(ui/2tt = 6.25 x 10~ 2 ) of a fast Fourier power spectrum, 
and the value of SNR was defined as the ratio of the peak 
intensity with the averaged noise intensity at 100 points 
of the proximate baseline over the higher frequency than 
lu + Alu. A transient memory domain appears between 
the non- firing domain ("NF") and the reverberating do- 
main ("R") (Fig. [5b). The SNR under conditions of a 
noise amplitude comparable to the perithrcshold signal 
tends to be largely irrelevant with regard to the coupling 
constant when e > 0.05 (Fig. [5f), and e-slice (slice at 
the constant e(0.05 < e < 0.20)) of Fig. [5f indicates the 
typical property of stochastic resonance, where applica- 
tion of noise with non-zero amplitude enhances SNR of 
the spectrum^. Apparently, variation of the decay rate 
depended on the noise amplitude, suggesting that noise 
plays an important role for signal transmission in the ring 
and that the various energetic states of the reverberating 
circuit can be defined using the firing rate, leading to the 
creation and stabilization of attractors (vide infra). 

Taking into account the behavior of transient memory 
storage of the ring, we designed an attractor switching 
electronic circuit integrated with inhibitory connections 
(Fig. [3b-). Inhibitory connections are important in vari- 
ous neural functions such as binocular rivalry in the vi- 
sual cortex [2l| and dynamical encoding of an olfactory 
system [23] . In particular, the spatio-temporal dynam- 
ics of the locust olfactory system are important for the 
coding of odor intensity and identity[23]. Our device is 
composed of two ring circuits with excitable modules. 
The output of ring B (eV® — 0.25V) is inhibitory and 
connected to ring A via feeding into the threshold setting 
port of ring A (Fig. [3b; see also Sections II. A and II. B for 
details), insuring that either ring A or B can fire. From 
the electronic circuit experiment and numerical simula- 
tion, the behavior of transient memory storage brings 
about a switching effect in the device (Figs. [3b and 2b- 
c). The default threshold value of ring A (V^ h = 0.03V 
for the experiment and 0.05 for the simulation) was set 
much lower than that of ring B (V^ h = 0.06V for the ex- 
periment and 0.20 for the simulation), which forces ring 
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A to be more likely to fire than ring B. If the input sig- 
nal amplitude or mean pulse input rate is large enough 
to fire ring B, then output A is depressed. Even if the 
input signal decreases to subthreshold for ring B, ring B 
reverberates for a while due to its transient nature. But 
ring A is disinhibited after the rest of ring B. In such 
a system, we can define a two-dimensional attractor as 
(i?A, Rb) in the phase space, where Ra and Rb are the 
firing rates of rings A and B, respectively. 

The application of noise with an appropriate ampli- 
tude endows the electronic circuit with a hysteresis ef- 
fect (Fig. and the numerical simulation of the de- 
vice qualitatively reproduced this experimental tendency 
(Fig. [3^). Interestingly, noise with an appropriate am- 
plitude (see the curves for D = 2.2 and 2.4V in Fig. [3}d 
and for D = 0.11 and 0.12 in Fig. QJi) is required for 
the device to show a clear hysteresis curve. The hys- 
teresis effect is due to the noise-driven transient memory 
storage effect of ring B and the asymmetric inhibitory 
connection. During the down-sweeping process of the 
input signal amplitude, the switching voltage becomes 
much lower than because of the above-mentioned 
reverberation of ring B. During the up-sweeping process, 
the onset voltage of the firing of ring B can be deter- 
mined only by V^ h and the noise amplitude, giving a 
higher switching voltage than that of the down-sweeping 
process. Thus, the ring network circuit of the excitable 
threshold system with inhibitory connections allows at- 
tractor switching with a hysteresis phenomenon. Addi- 
tionally, the number of N greatly affected the hysteresis 
(Fig. 2b) . A device with the larger N produced the larger 
coercivity in the hysteresis loop, indicating that the de- 
vice would be tied to past memory rather than new envi- 
ronmental sensory input. Furthermore, the device with 
larger N behaved more deterministically and less prob- 
abilistically, and vice versa. From the above discussion, 
we found the higher-order function that originated from 
SR; that is, noise-driven signal propagation causes the 
transient memory effect of the ring, which in turn pro- 
vides the function of a noise-driven attractor switching 
effect with hysteresis. 

In order to investigate whether the above-mentioned 
property of the two-ring system with asymmetric inhi- 
bition can be generalized to other neuronal models, we 
performed the similar simulation using a canonical model 
of a class 1 neural network pill [i~2l Hij . Details of the con- 
ditions for the simulation are given in the caption of Fig. 
[5] and Sec. II. E. Figs. [5^,-c show the variation of depen- 
dence of mean firing rate for the fourth module (to = 4) 
of rings A and B on noise amplitude (D), the number of 
parallels (TV) in a module, and input frequency (u>), re- 
spectively (see Fig. [5] for device architecture). The qual- 
itative tendencies with respect to D, N and u> were the 
same as those for the simple threshold system described 
above (Fig. [4j; that is, i) noise with proper amplitude 
is required for the device to show clear hysteresis, and 
ii) the larger the number of N and input frequency, the 
larger the coercivity of hysteresis, and iii) the moderate 



sweep frequency is required to draw clear hysteresis. 

The results shown by the simple threshold system and 
the canonical model of a class 1 neural network are phe- 
nomenologically consistent with recent results showing 
hysteresis effects in stereopsis and binocular rivalry in 
humans [24] . In the literature, hysteresis is measured 
as a function of orientation disparity in tilted gratings 
in which a transition is perceived between stereopsis 
and binocular rivalry. A fast tilting rate, which corre- 
sponds to high-frequency input in our case, results in 
enhancement of coercivity. Furthermore, a smaller op- 
tical Michelson contrast of a sinusoidal grating causes 
a larger coercivity. A previous functional magnetic res- 
onance imaging study concerning a general mechanism 
for perceptual decision-making indicated that several 
brain regions associated with the attentional network 
show a greater response when the task becomes more 
difficult [2^1 . Since a test with a smaller grating contrast 
involves a more difficult task, the region requires more at- 
tentional resources for correct performance; that is, the 
number of neurons (corresponding to N) associated with 
the task could be larger. This is consistent with our re- 
sult that the device with larger N gives larger coercivity. 

The current type of stochastically excitable thresh- 
old device in our study essentially requires two parts: 
a noise generator and comparator. If these components 
are represented by novel materials beyond silicon mate- 
rials, novel bio-inspired devices will be realized. Criti- 
cal dynamics near the phase transition point at ambi- 
ent temperature will be available to the noise genera- 
tor if the dynamics are coupled to physical properties 
such as electric conductivity. Furthermore, field-induced 
phase transition will be of practical importance in realiz- 
ing the comparator. Future development on suitable ma- 
terials for the comparator with a threshold voltage much 
lower than that of conventional analog operational ampli- 
fiers (namely, conventional transistors) will yield attrac- 
tor switching devices with ultra-low energy consumption 
like the brain. 



IV. CONCLUSION 

Problems with artificial neural networks originate from 
their deterministic nature and inevitable prior learn- 
ings, resulting in inadequate adaptability against unpre- 
dictable, abrupt environmental change. In this article 
we showed that a stochastically excitable threshold unit 
can be utilized by these systems to partially overcome 
the environmental change; that is, timing of attractor 
switching is varied depending on not only on the sen- 
sory input but also on the memory stored in the ring. 
Noise-driven attractor stabilization and switching were 
embodied by a multiple ring network with inhibitory con- 
nections. Noise works as a power source to stabilize and 
switch attractors, and endows the system with hysteresis 
behavior that resembles that of stereopsis and binocular 
rivalry in the human visual cortex. In order to further in- 
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vestigate the property of the multiple ring network with 
inhibitory connections, we performed the numerical sim- 
ulation of a canonical model of class 1 neurons, where the 
result showed properties that were similar to the simple 
threshold system. The device shown in this article will 
also inspire the material science and engineering in fab- 
rication of noise generators and comparators using func- 
tional materials with critical dynamics near the phase 
transition at ambient temperature and/or field- induced 
phase transition. 
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VI. APPENDIX 

A. Parameters for numerical simulation and 
electric circuit experiments 

Here we provide all the parameters for the numerical 
simulations. For the simulation of simple threshold units, 
the parameters for the simulations in Figs. [2ji-f and[4^-c 
were tabulated in Tabl^J 

For the sumulation of the canonical model of a class 
1 neurons(Fig. O, All the parameters are tabulated in 
Table HU 
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TABLE I: Parameters for the numerical simulation of simple threshold units shown in Figs. (2ji-f and|4^,-c. 





numerical simulations 


elec. circuit 


figure number 


2d|2eandf| 4a| 4b| 4c 


3b 


1\/T 


4 


4 


AT 

1 V 


1 - 1000 


100 


1 


1 - 100 


100 


i 


y'i'h 
v m 


0.10 


0.20 










eV m 


0.16 


- 0.50 












128 










VX h 






0.05 


0.03V 


V£ h 






0.20 


0.06V 


eV£ 






0.30 


0.16V 


eV» 






0.30 


0.25V 


w/2tt 


6.25 xlO - * (=1/16) |10~ b -10 u 


0.3Hz 


D 


0.10 1 - 0.50 10.05 - 0.13 1 0.11 


1.6V - 2.8V 


T 


16 




time- step 


1 


lxlO^s 


averaging time 


64 


0.1s 



TABLE II: Parameters for the numerical simulation shown in Fig. [6] 



figure number 


6a | 6b 


6c 


M 
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N 
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50 
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-0.008 
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e A 


0.5 


e » 


0.5 
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Lo/2-IT 


1.0xl0" a 


2.0 x 10~ 4 - 5.0 x 10" a 


D 


6.0xl0~ 4 - 1.4xl0" a | 1.0xl0 -;i 


1.0xl0~ a 


KA 


1.5 


kb 


1.5 


time-step 


0.05 


averaging time 


50 
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inputs adder inverter comparator inverter I I I I 

negative outputs 
clipper 

FIG. 1: Analog electric circuit diagram of a simple excitable 
threshold unit (McCulloch-Pitts neuron[i|). The unit con- 
sists of external signal inputs including sensory signals and 
signals from the other modules or rings, external noise input, 
a summation of these components, a successive comparator 
and an output port. The negative clipper is inserted between 
the comparator and output port in order to insure that an 
output with asymmetric voltage is obtained. Ri and R2 are 
10 kSl and 100 kf2, respectively. We used quad operational 
amplifiers, TL084 (Texas Instruments, inc.). The positive and 
negative electric power source used for the amplifiers was ± 
12 V. 




012345 012345 
10e 10e 



FIG. 2: (a) An excitable unit is composed of the follow- 
ing four parts: signal input ports (an external sensory input, 
the signals from the other units, and external noise), sum- 
mation of these input signals, a successive comparator, and 
an output port. The dimensionless output amplitude of the 
comparator is set to unity, (b) A summing parallel network 
module (number of units: N) of the excitable units of (a), 
with time delay. This is a version of the so-called Collins- 
type excitable network !20| with time delay. The input signal 
is fed into the input port of each unit. Signal averaging is 
performed prior to the delay, (c) A ring circuit consists of 
M directionally coupled modules (b). The value e denotes 
the coupling constant between rings, which scales the output 
voltage of the rings, (d) Variation of transients of the output 
signal of the ring circuit of M — 4 as a function of the num- 
ber of parallels in a module, N. The other parameters used 
for the simulation were as follows and summarized in Table 
Uin Appendix: eV m (V m ' output amplitude): 0.16, threshold 
amplitude of comparators (V„ ): 0.10, noise amplitude (D): 
0.10, signal delay at each excitable unit: 16, input signal func- 
tion: cos(27rt/16), input pulse width(tp W ): 128, and time-step 
for all simulations: 1. (e,f) Simulated (t,D) phase diagrams 
for relaxation rate (e) and signal-to-noise ratio (SNR) (f) for 
the ring with (M, N) = (4,100) are shown. V£ h was 0.20. 
"NF" at the scale bar of (e) stands for "non-firing." Note 
that the scale bar of (f) is nonlinear. 
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FIG. 3: (Color online) (a) A circuit diagram of the attractor 
switching device. A detailed electric circuit design is pre- 
sented in Sec. II. A. (b) The experimental result of the device 
with (M,N) = (4,1) rings. The firing rates of the fourth 
module in both rings was monitored as functions of the input 
signal and noise amplitudes. The parameters for the experi- 
ment were as follows: eV£: 0.16 V, eV„: 0.25 V, Vg h : 0.03 
V, and V B Th : 0.06 V. D was varied from 1.6 V to 2.8 V with a 
step of 0.2 V. See Sec. II. C for the details of the experiments. 
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FIG. 4: (Color online) (a) The simulated mean firing rate 
for the devices with (M,N) = (4,1). The parameters for the 
simulation were as follows: V^ h : 0.05, V^ h : 0.20, eV£: 0.30, 
and eV%: 0.30. D was set to 0.05, 0.10, 0.11, 0.12, and 0.13. 
The other parameters were set to values as indicated in Fig. 
[2] and also in Table U in Appendix. The inhibitory connection 
was implemented by varying the threshold amplitude: V^ h = 
0.05 at the disinhibition state and 2.00 at the inhibition state, 
(b) The response of the device was explored as a function of N 
while D was fixed at 0.11. (c) The frequency response of the 
device with N = 100 and D = 0.11 is shown. The moderate 
sweep frequency was necessary for hysteresis behaviors. 
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FIG. 5: (Color online) A circuit diagram of the attractor 
switching device. The output signals of all the modules in 
ring B were fed into the signal input ports of all the modules 
of ring A. 
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FIG. 6: (Color online) The simulated mean firing rate for 
the canonical model of class 1 neurons as a function of noise 
amplitude (D)(a), the number of iV(b), an d input frequency 
(w)(c). (M,iV) = (4,4), r A =-0.008, and r fl =-0.020. The exci- 
tatory coupling constants (e^ and e^) were 0.5 and the in- 
hibitory connection (ej n h) from ring B to ring A was 3.0. For 
a) and b), the input sinusoidal signal is 0.019 x sin(urf), where 
cj/2tt=1.0x10" 3 . For b) and c), D=1.0xl0~ 4 . For a) and c), 
N=50 The network is composed of slowly connected class 1 
neurons with the time constant ka=kb=1-5. Details of the 
simulation are given in Sec. II. E and Table HT1 in Appendix. 
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